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FRICATIVES 
Novelty Processing 



Channel 


Center 
Start 


Center 
Length 


Center 
Width 


Alpha 


Surround 
Start 


Surround 
Length 


Surround 
Width 


0 


10 


6 


1 


0.6 


0 


all 


1 


1 


4 


3 


8 


0.7 


6 


8 


3 


2 


0 


4 


2 


0.7 


1 


8 


10 


3 


1 


2 


2 


1.0 


0 


all 


1 


4 


10 


4 


4 


0.9 


0 


all 


1 


5 


0 


1 


10 


1.1 


4 


2 


14 



FIG. 4 

Coincidence Processing. The output size is 576 
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FIG. 5 



VOWELS 
Novelty processing. 
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FIG. 6 

Coincidence Processing. The output size is 696. 
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FIG. 7 



NONFRICATIVES 



Novelty Processing. 



Channel 


Center 
Start 


Center 
Length 


Center 
Width 


Alpha 


Surround 
Start 


Surround 
Length 


Surround 
Width 


0 


4 


4 


1 


1.0 


3 


2 


3 


1 


4 


4 


8 


0.6 


0 


All 


1 


2 


0 


2 


1 


1.1 


0 


3 


10 


3 


6 


6 


4 


0.7 


0 


All 


1 


4 


1 


2 


2 


0.6 


0 


All 


1 


5 


1 


4 


6 


1.2 


10 


20 


8 



FIG. 8 

Coincidence Processing. The output size is 697. 
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Default signal flow is from one line to the next. 
The general syntax is: 

input 1:, input2: — > processName — > output: with/from/to parameter-list 



mu: 
mu: 
input: 



cvp: 



cvp: 



with 192 192 
with cancel 1 
128 32 

with Four4 57.tab 



1 1 1 

eng: ,c 



putinmaxflo — > 
— > mu lawRT — > mu: 
— > procrustes — > spf: 
— > echocancel — > input: 
— > chunkify — > with 
— > remove_mean — > rem: 
— > mv multiply — > dft: 
— > cvpower — > cvp: 
— > procrustes — > with 
— > record_stats — > eng: 
— > harming — > han: 
— > procrustes — > with 
— > compress — > c: with normalize 1111111111 1111111111 111 
2222222 2 222222-1 



1 54 
with 

1 54 



sum no normalize 



— > concatenate — > 
— > log2 — > log40: 



log40: — > noveltyRT --> 
— > normalize — > 

,eng: — > zeroOnLow — > 
— > extract — > ev: 

ev: — > eTrigger — > tv: 

ev:, tv: — > coincidenceRT — > 
— > normalize — > v: 



with 1.0 



with 



log40: — > noveltyRT --> 
— > normalize — > 

,eng: — > zeroOnLow — > 
— > extract — > ef: 

ef: — > eTrigger — > tf: 

ef:, tf: — > coincidenceRT — 
— > normalize — > f: 



vowels 

with no mul vowels. Iog40 silvowels.log40 

with 0.0 
with 3 24 12 
with 6 2441 
with 6 24 41 vowels 
with no muvowels.p4 sivowels.p4 



with 



fricatives 

with no mul fricatives.log40 si 1 fricatives. Iog40 

with 0.0 
with 3 24 12 
with 6 24 41 
with 6 24 41 fricatives 
with no mufricatives.p4 sifricatives.p4 



log40: — > noveltyRT --> 
— > normalize — > 

,eng: — > zeroOnLow — > 
— > extract — > en: 

en: — > eTrigger — > tn: 

en:, tn: — > coincidenceRT — > 
— > normalize — > nf: 



with nonfricatives 
with no mulnonfricatives.log40 si 1 nonfricatives. Iog40 
with 0.0 
with 3 24 12 
with 6 2441 
with 6 24 41 nonfricatives 
with no munonfricatives.p4 sinonfricatives.p4 
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v:, f: — > concatenate — > 
, nf: — > concatenate — > 

— > mean_square_norm — > ms: with yes yes 

ms: — > mvmultiply — > with k.GA _ 

— > map — > with npllr.GA 

— > nBest — >best: with 7 

eng: — > extract — > with 3 24 23 

— > record_stats — > eLong: with sum normalize 

eLong: — > log2 — > with 1.0 

,best: — > scale — > ebest: with long 1 000.0 200.0 

spf: — > delay — > with 1 1 

— > extract — > with 3 1 0 

— > scale — > sps: with long 

sps:,ebest: — > concatenate — > 
— > putoutAS 
stop 
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List of Processes 
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- aggregates the sound data stream into overlapping segments 

- see main text 

- aggregates each data vector into the given bins by averaging over bin 

- concatenates each pair of incoming vectors into one output vector 

- computes power spectrum from complex DFT spectrum 

- delays a data stream 

- see main text 

- performs echocancelling using voice in and voice out streams 

- extracts a time window of specified width and decimation 

- standard hanning filter 

- log base2 

- applies a nonlinear, pointwise transform as specified by control file 

- normalizes each vector by mean and standard deviation 

- inverse mu-law 

- matrix-vector multiply 

- zeros out all but the N highest elements of a vector 

- subtracts constant mean vector, and divides by a constant scale vector 

- see main text 

- provides input data stream from system 

- accepts output phonetic stream to pass on to rest of system 

- computes mean and sigma for each vector 

- subtracts the vector mean from each vector 

- selects a contiguous central portion of a vector 

- zeros a vector according to empirical low energy condition 



- Fourier coefficient matrix 

- matrix of phonetic vector-coefficients 

- constant mean vector 

- constant mean vector 

- constant mean vector 

- constant mean vector 

- constant mean vector 

- constant mean vector 

- specifies nonlinear transform to create log-likelihood ratio output 

- constant scale vector 

- constant scale vector 

- constant scale vector 

- constant scale vector 

- constant scale vector 

- constant scale vector 
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The ScaleMean object as referenced by normalizeRT. 

#include "StdAfx.h" 
#include <stdlib.h> 
#include <stdio.h> 
#include <assert.h> 
#include <math.h> 



#define MAXMEM 100 

class ScaleMean 
{ 

Zbuffer *buf0; 
int start; 
int length; 
int width; 

rf| int numberlnBufO; 

H float* flnTime[ MAX MEM ]; 

in 

^? public: 

^ ScaleMean(); 

*" M float get( int i ); 

void init( Zipper* aZipper, int aStart, int aLength, int aWidth); 
void update( Zipper* zl ); 
float sides( Zipper* zl, int i ); 

}; 



o 



Ui 

'm 



Ml 



ScaleMean: : ScaleMean() 

{ 

bufO = NULL; 

} 

void ScaleMean: :init( Zipper* aZipper, int aStart, int aLength, int aWidth) 

{ 

start = aStart; 
length = aLength; 
width = aWidth; 
numberlnBufO = 0; 
if(bufO = NULL) 

bufO = new Zbuffer ( "bufO", aZipper->getType(), aZipper->getSize(), 

start+length ); 
else 

bufO->zero(); 

} 
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float ScaleMean::sides( Zipper* zl, int i ) 
{ 

float sidesSum = (float) 0.0; 
float sidesMean; 

float* pf = (float*) zl->getData(); 

// Energy has no sides 
if(i = 0) 

return pf[0]; 

int n = 0; 

int size = (int) zl->getSize(); 
// Add in sides where possible, 
int f = max( 1, i - width ); 
int fEnd = min( size-1, i + width ); 
while (f<=ffind) { 

sidesSum += pf[f++]; 

n++; 

} 

sidesMean = (float) quo( sidesSum, ( float ) n ); 
return sidesMean; 

} 

void ScaleMean::update( Zipper* zl ) 
{ 

bufO->update(); 

Zipper* zO = buf0->get( buf0->getLength()-l ); 
float *pf = (float*) zO->getData(); 
for ( long i = 0; i < (long) zl->getSize(); i++ ) { 
pf[i] = sides( zl, i ); 

} 

if (numberlnBufO < (int) bufO->getLength()) numberInBufO++; 

int len = bufO->getLength(); 

for (int j = 0; j < len; j++ ) 

{ // Find the time in the past. 

Zipper *pz0 = buf0->get(len - 1 - j ); 

ftnTime[ j ] = ( float* ) pz0->getData(); 

} 

} 
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float ScaleMean::get( int i ) 

{ 

float scaleSum = (float) 0.0; 
float scaleMean; 

// Just average over the ones we actually have, 
float n = 0.0; 

for ( int j = start; j < numberlnBufO; j++ ) { 
float* fin = flnTime[j]; 
scaleSum += fln[i]; 
n++; 
} 

scaleMean = (float) quo( scaleSum, n ); 
return scaleMean; 
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The NoveltyRT process. See Attachment 2 for the definition of the ScaleMean object. 
Usage - 

data:, speaking: — > NoveltyRT — > with whichLabelset 

*/ 

#include "StdAfx.h" 
#include <stdlib.h> 
#include <stdio.h> 
#include <assert.h> 
#include <math.h> 

#include "speedObject.h" 
#include "scalemean.h" 

#defme MAX_SCALES 10 

class NoveltyRT : public SpeedProcess 

{ 

public: 

NoveltyRT(); 
~NoveltyRT(); 

int begin (); 

int beginFile(Zipper* zl, Zipper* z2 ); 

Zipper* processZipper( Zipper* zl, Zipper* z2 ); 

Zipper* finalFileZipper (); 

void accumMeanAllTime(); 

float getScaleMeanAHTime( int i ); 

void universal( int size, ScaleMean* center, ScaleMean* surround, double alpha ); 

private: 

Zbuffer *bufO; 

int numberOfScales; 
int outSize; 
int whichFlavor; 
BOOL bSpeaking; 

ScaleMean* cScales[ MAXJSCALES ]; 
ScaleMean* sScales[ MAX_SCALES ]; 
double alpha[ MAX_SCALES ]; 

Zbuffer *allTimeSum; 
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Zipper* pZallTimeSum; 

float allTimeCount; 



int iout; 

Zipper* theZout; 

void put( double x ) { theZout->put( iout++, x ); } ; 

}; 



NoveltyRT::NoveltyRT() : SpeedProcess( "NoveltyRT" ) 
{ 

allTimeSum = NULL; 
bufO = NULL; 

} 

NoveltyRT : :~No veltyRT() 
{ 

delete allTimeSum; 

} 

/* NoveltyRT - called from initNet() in netnode.cpp 
* whenever a node is created for this process. 
*/ 

SpeedObject* noveltyRT() 
{ 

return (new NoveltyRT); 

int NoveltyRT: :begin () 
{ 

whichFlavor = (int) parameters->askWords( "fricatives nonfricatives vowels" ); 
allTimeSum = NULL; 
bufD = NULL; 

for ( int i=0; i < MAX_SCALES; i++ ) { 
cScales[i] = NULL; 
sScales[i] = NULL; 

} 

return TRUE; 

} 

Zipper* NoveltyRT: :finalFileZipper () 

{ 

cout « "Spectrum for Transaction:" « endl; 
if (allTimeCount >0) 

for ( int i = 0; i < pZallTimeSum->getSize(); i++ ) 

cout « pZallTimeSum->get(i)/allTimeCount « " "; 
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cout « endl; 



dataState = BUF_EOT; 
return NULL; 

int NoveltyRT::beginFile(Zipper* zl, Zipper* z2) 

{ 

assert( zl->getType() = ELIZA_FLOAT ); 
for ( int i=0; i < MAX_SCALES; i++ ) { 

delete cScales[i]; 

delete sScales[i]; 

cScalesfi] = NULL; 

sScalesfi] = NULL; 

} 



// FRICATIVES 

if ( whichFlavor = 0 ) { 

numberOfScales = 6; 

cScales[0] = new ScaleMean(); 

cScales[0]->init( zl, 10, 6, 1 ); 

sScales[0] = NULL; 

alpha[0] = 0.6; 

cScales[l] = new ScaleMean(); 
cScales[l]->init( zl, 4, 3, 8 ); 
sScales[l] = new ScaleMean(); 
sScales[l]->init( zl, 6, 8, 3 ); 
alpha[l] = 0.7; 

cScales[2] = new ScaleMean(); 
cScales[2]->init( zl, 0, 4, 2 ); 
sScales[2] = new ScaleMean(); 
sScales[2]->init( zl, 1, 8, 10 ); 
alpha[2] = 0.7; 

cScales[3] = new ScaleMean(); 
cScales[3]->init( zl, 1, 2, 2 ); 
sScales[3] = NULL; 
alpha[3] = 1.0; 

cScales[4] = new ScaleMean(); 
cScales[4]->init( zl, 10, 4, 4 ); 
sScales[4] = NULL; 
alpha[4] = 0.9; 
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cScales[5] = new ScaleMean(); 
cScales[5]->init( zl, 0, 1, 10 ); 
sScales[5] = new ScaleMean(); 
sScales[5]->init( zl, 4, 2, 14 ); 
alpha[5] = 1.1; 



// VOWELS 

else if ( whichFlavor = 2 ) { 
numberOfScales = 6; 

cScales[0] = new ScaleMean(); 
cScales[0]->init( zl, 6, 4, 4); 
sScales[0] = new ScaleMean(); 
sScales[0]->init( zl, 0, 8, 4); 
alpha[0] = 0.6; 

cScales[l] = new ScaleMean(); 
cScales[l]->init( zl, 0, 2, 1 ); 
sScales[l] =NULL; 
alpha[l] = 1.0; 

cScales[2] = new ScaleMean(); 
cScales[2]->init( zl, 4, 6, 6 ); 
sScales[2] = NULL; 
alpha[2] = 0.9; 

cScales[3] = new ScaleMean(); 
cScales[3]->init( zl, 8, 6, 3 ); 
sScales[3] = new ScaleMean(); 
sScales[3]->init( zl, 8, 16, 20 ); 
alpha[3] = 0.8; 

cScales[4] = new ScaleMean(); 
cScales[4]->init( zl, 0, 3, 6 ); 
sScales[4] = new ScaleMean(); 
sScales[4]->init( zl, 2, 4, 14 ); 
alpha[4] = 1.2; 

cScales[5] = new ScaleMean(); 
cScales[5]->init( zl, 4, 1, 1 ); 
sScales[5] = new ScaleMean(); 
sScales[5]->init( zl, 2, 4, 12 ); 
alpha[5] = 0.9; 
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//NONFRICATIVES 

else if ( whichFlavor = 1 ) { 
numberOfScales = 6; 

cScales[0] = new ScaleMean(); 
cScales[0]->init( zl, 4, 4, 1 ); 
sScales[0] = new ScaleMean(); 
sScales[0]->init( zl, 3, 2, 3 ); 
alpha[0] = 1.0; 

cScales[l] = new ScaleMean(); 
cScales[l]->init( zl, 4, 4, 8 ); 
sScales[l]=NULL; 
alpha[l]=0.6; 

cScales[2] = new ScaleMean(); 
cScales[2]->init( zl, 0, 2, 1 ); 
sScales[2] = new ScaleMean(); 
sScales[2]->init( zl, 0, 3, 10 ); 
alpha[2] = 1.1; 

cScales[3] = new ScaleMean(); 
cScales[3]->init( zl, 6, 6, 4 ); 
sScales[3] = NULL; 
alpha[3] = 0.7; 

cScales[4] = new ScaleMean(); 
cScales[4]->init( zl, 1, 2, 2 ); 
sScales[4] = NULL; 
alpha[4] = 0.6; 

cScales[5] = new ScaleMean(); 
cScales[5]->init( zl, 1, 4, 6 ); 
sScales[5] = new ScaleMean(); 
sScales[5]->init( zl, 10, 20, 8 ); 
alpha[5] = 1.2; 

} 

allTimeCount = (float) 0.0; 

outSize = zl->getSize() * numberOfScales; 

if(buf0 = NULL) 
{ 

// We need a min of 3 for finding energy in accumMeanAHTime. 
bufO = new Zbuffer ( "bufO", zl->getType(), zl->getSizeQ, 3 ); 
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); 



allTimeSum = new Zbuffer( "allTimeSum", zl->getType(), zl->getSize(), 1 
pZallTimeSum = allTimeSum->get( 0 ); 

} 

else 

allTimeSum->zero(); 
return TRUE; 



} 



/* Returns the mean for all time in this file. 
*/ 

void NoveltyRT::accumMeanAllTime() 
{ 

// Get average of energy AROUND time 1 . 
float energy = (float) 0.0; 
O for(inti = 0;i<3;i++) 

if energy += (float) bufO->get(i)->get(0); 

f* energy = (float) (energy / 3.0); 

S T] 

Vj /* Check fixed energy threshold. */ 

m if (energy > 22) 

CO { 

» float *pfSum = (float*) pZallTimeSum->getData(); 

Q allTimeCount-H-; 

for ( i = 0; i < (int) pZallTimeSum->getSize(); i++ ) 
{ 

float newVal = (float) buf0->get( 1 )->get(i); 
^ pfSumfi] += newVal; 



} 



} 

} 

return; 



float NoveltyRT::getScaleMeanAHTime( int i ) 

{ 

float scaleSum = (float ) pZallTimeSum->get( i ); 
return (float) quo( scaleSum, allTimeCount ); 

} 

Zipper* NoveltyRT::processZipper(Zipper* zl, Zipper* z2) 
{ 

Zipper* zout = Zipper: :createZipper( ELIZA FLOAT, outSize ); 
zout->zero(); 
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bSpeaking = FALSE; 

if(z2) bSpeaking = int(z2->get(0)); 

// Store the input data in memory. 

bufO->put( zl ); 

if(bSpeaking) { 

} else 

accumMeanAllTime(); 

// compute the multiscale NoveltyRT for each input point, 
iout = 0; 
theZout = zout; 

for (int b = 0; b < numberOfScales; b++) { 
if(cScales[b] !=NULL) 

cScales[b]->update( zl ); 
if(sScales[b] != NULL ) 

sScales[b]->update( zl ); 
universal zl->getSize(), cScales[b], sScales[b], alpha[b] ); 
} 

return zout; 

} 

void NoveltyRT: :universal( int size, ScaleMean* center, ScaleMean* surround, double 

alpha ) 

{ 

double scaleMean, scaleMean2, theNovelty; 

if ( surround = NULL ) { 

for (int i = 0; i < size; i++ ) { 

scaleMean = center->get( i ); 
scaleMean2 = getScaleMeanAHTime( i ); 
theNovelty = scaleMean - alpha * scaleMean2; 
put( theNovelty ); 

} 

} 

else { 

for (int i = 0; i < size; i++ ) { 

scaleMean = center->get( i ); 
scaleMean2 = surround->get( i ); 
theNovelty = scaleMean - alpha * scaleMean2; 
put( theNovelty ); 

} 

} 

} 
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Usage - 

— > coincidenceRT — > with nameO | namel | etc. 

Function - 
*/ 

#include "StdAfx.h" 
#include <stdlib.h> 
#include <stdio.h> 
#include <string.h> 
#include <assert.h> 
#include <math.h> 

#include "speedObject.h" 
#include "eTrigger.h" 

class CoincidenceRT : public SpeedProcess 



CoincidenceRT(); 
~CoincidenceRT(); 

int begin (); 

int beginFile(Zipper* zl, Zipper* z2); 
int final(); 

Zipper* processZipper (Zipper*, Zipper*); 
double get( int t, int f, int offset ) 
{ 

if(t<0) 

return 0.0; 

else 

return pin[ t * inputStride + offset + f ]; 

> 

int numberOfScales; 
int numberOfTimes; 
int gateStride; 
int columnSize; 
int localFreqSize; 

private: 

int whichProcess; 
BOOL countMode; 
BOOL bSetSize; 



public: 



CO 



Til 



public: 
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int nTotal; 

int inputStride; 
int deltaWidth; 
int deltaStep; 
float *pin; 
char* pGate; 
float *pout; 

float* getAddr( int t, int f, int offset ) { 

return pin + (t * inputStride + offset + f); 

} 

void put( double x ) { 

if ( countMode ) 
nTotal++; 

else 

*pout++ = (float) x; 

} 

void doFricatives2(); 
void doNonFricatives2(); 
void doVowels2(); 
void doGA(); 
void doNonFricatives(); 
void doVowels(); 
void doFricatives(); 
void dispatch(); 

void eCrossColumn( int delta, int tstart, int tstop, int fWidth, int whichScale); 
void eCrossColumn( eGateType eGate, int delta, int tstart, int tstop, int fWidth, int 
whichScale ); 

void selfAddLocalFreq( int tstart, int tstop, int localN, int whichScale ); 
void selfAddLocalFreq( eGateType eGate, int tstart, int tstop, int localN, int 
whichScale ); 

void crossAddLocalFreq( int delta, int tstart, int tstop, int fWidth, int whichScale ); 
void crossAddLocalFreq( eGateType eGate, int delta, int tstart, int tstop, int 
fWidth, int whichScale ); 

}; 

int CoincidenceRT::begin() 

{ 

deltaWidth = localFreqSize = 4; 
deltaStep = 1; 

numberOfScales = (int) parameters->AskUser("Number of scales from novelty", 
« 0.0, 10.0, 10.0); 
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numberOfTimes = (int) parameters->AskUser("Number of times in RF", 0.0, 
100.0, 100.0); 

gateStride = numberOfTimes * numberOfScales; 

localFreqSize = (int) parameters->AskUser("Local Frequency Size", 0.0, 100.0, 
100.0 ); 

whichProcess = parameters->askWords("GA nonfricatives vowels fricatives"); 
bSetSize = TRUE; 
return TRUE; 

} 

void CoincidenceRT::dispatch() 

{ 

switch (whichProcess) { 
case 0: 

doGA(); 
break; 

case 1: 

doNonFricatives(); 
break; 

case 2: 

doVowels(); 
break; 

case 3: 

doFricatives(); 
break; 

int CoincidenceRT::beginFile(Zipper* zl, Zipper* z2) 

{ 

// Simulate one run in countMode 
pin = (float *) zl->getData(); 
pGate = (char *) z2->getData(); 
if (bSetSize) 
{ 

columnSize = zl->getSize() / ( numberOfScales * numberOfTimes ); 
inputStride = numberOfScales * columnSize; 



nTotal = 0; 
countMode = TRUE; 
dispatch(); 

countMode = FALSE; 
int nf = columnSize- 1; 
int nfl = nf / localFreqSize; 
bSetSize = FALSE; 

cout « "CoincidenceRT: stride " « inputStride; 
cout « " columnSize " « columnSize; 
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//cout « " nfl is " « nfl « " nTotal = " « nTotal; 
cout « endl; 



} 

return TRUE; 



} 



Zipper* CoincidenceRT::processZipper (Zipper* zl, Zipper* z2) 



pin = (float *) zl->getData(); 
pGate = (char *) z2->getData(); 

Zipper* zOut = Zipper: :createZipper( ELIZAFLOAT, nTotal ); 
zOut->zero(); 

pout = (float *) zOut->getData(); 

//dist->increment( ehi[l] - ehi[0]); 

dispatch(); 

return zOut; 



eCrossColumn( eDeltaMinus, -6, 6, 24, 6, 2 ); 
eCrossColumn( eDeltaPlus, 1, 12, 23, 3,2); 
eCrossColumn( eDeltaMinus, 0, 3, 24, 2, 3 ); 
eCrossColumn( eDeltaPlusM2, -5, 5, 24, 1,3); 
eCrossColumn( eMinus, -5, 22, 24, 8,4); 
eCrossColumn( ePlus, 0, 8, 13, 1,4); 
eCrossColumn( eDeltaPlusP2, -7, 7, 24, 6, 5 ); 
eCrossColumn( eDeltaPlus, 3, 0,21, 16,5); 
eCrossColumn( ePlus, -5, 8, 24, 16,5); 
selfAddLocalFreO( eDeltaMinus, 7, 24, 6, 5 ); 
selfAddLocalFreq( 14, 24, 10,5); 

selfAddLocalFreO( eMinus, 1, 24, 5,5); 
selfAddLocalFreO( eDeltaPlus, 1, 24, 8,2); 
selfAddLocalFreO( eDeltaMinus, 0, 22, 13,1); 
selfAddLocalFreO( eMinus, 0, 7, 6, 1 ); 
selfAddLocalFreO( eDeltaMinus, 3, 24, 11,0); 
crossAddLocalFreO( eDeltaPlus, 2, 0, 22, 9, 1 ); 
crossAddLocalFreO( eDeltaMinus, 3, 0, 21, 15, 1 ); 
crossAddLocalFreO( eDeltaPlusP2, 2, 0, 22, 6,2); 
crossAddLocalFreO( 1, 13, 23, 11,2); 

cross AddLocalFreO( -3, 3, 24, 5, 3 ); 

crossAddLocalFreO( -1, 1, 24, 3,3); 



void CoincidenceRT: :doFricatives() 

{ 



//output size is 576 
eCrossColumn( ePlus, 
eCrossColumn( eMinus, 



-1, 1, 12, 7,0); 
1, 0, 14, 13,2); 
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crossAddLocalFreO( ePlus, -4, 4, 24, 12, 5 ); 
crossAddLocalFreO( ePlus, 3, 0, 21, 11,5); 
crossAddLocalFreO( eMinus, -2, 2, 24, 11,5); 

void CoincidenceRT: :doNonFricatives() 
{ 

//output size is 697 

eCrossColumn( eDeltaPlus, -7, 7, 16, 10,0); 
eCrossColumn( eMinus, 0, 0, 23, 10,0); 
eCrossColumn( -2, 2, 24, 4,0); 

eCrossColumn( ePlus, -7, 7, 17, 6,1); 
eCrossColumn( eDeltaPlus, -1, 14, 24, 10,1); 
eCrossColumn( eDeltaPlus, 1, 0, 23, 2,2); 
eCrossColumn( eDeltaMinus, 0, 0, 24, 4,2); 
eCrossColumn( eDeltaPlus, -1, 1, 24, 13,2); 
eCrossColumn( ePlus, 2, 0, 18, 10,4); 
eCrossColumn( eMinus, -5, 10, 24, 5, 5 ); 
selfAddLocalFreO( ePlus, 4, 18, 17,0); 
selfAddLocalFreO( eDeltaMinus, 0, 24, 5,0); 
selfAddLocalFreO( eDeltaPlusM2, 5, 23, 6, 1 ); 
selfAddLocalFreq( 1, 24, 4,2); 

cross AddLocalFreO( eMinus, 3, 0, 21, 5,0); 
crossAddLocalFreq( ePlus, -2, 2, 24, 12,0); 
crossAddLocalFreO( -4, 4, 24, 6, 2 ); 

crossAddLocalFreO( 1, 0, 23, 5,2); 

crossAddLocalFreO( -2, 2, 24, 5,3); 

crossAddLocalFreO( eDeltaPlus, 1, 0,23, 6,4); 
crossAddLocalFreO( -4, 4, 24, 9,4); 

crossAddLocalFreO( -7, 7, 24, 8,4); 

crossAddLocalFreO( eDeltaPlus, -2, 2, 24, 3,4); 
crossAddLocalFreq( eDeltaPlusP2, -3, 3, 24, 10,4); 
crossAddLocalFreq( -6, 6, 24, 13, 5 ); 

crossAddLocalFreq( eDeltaPlus, 2, 9,22,13,5); 

} 

void CoincidenceRT ::doVowels() 
{ 

//output size is 696 

eCrossColumn( ePlus, -7, 7, 22, 9, 1 ); 
eCrossColumn( eDeltaPlusM2, -2, 2, 24, 5,1 ); 
eCrossColumn( ePlus, 2, 0,21, 3,1); 
eCrossColumn( eMinus, -7, 17, 21, 4,2); 
eCrossColumn( eDeltaMinus, -4, 4, 24, 13, 2 ); 
eCrossColumn( eDeltaPlus, -7, 7, 24, 6, 3 ); 
eCrossColumn( -7, 7, 12, 6, 3 ); 
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eCrossColumn( eMinus, -6, 6, 24, 4, 3 ); 
eCrossColumn( eDeltaMinus, -2, 2, 24, 10,4); 
selfAddLocalFreO( eDeltaPlusP2, 5,23, 16,4); 
selfAddLocalFreO( ePlus, 2, 24, 3, 5 ); 
selfAddLocalFreO( eDeltaMinus, 6, 24, 16, 5 ); 
selfAddLocalFreO( eDeltaMinus, 0, 21, 16,0); 
selfAddLocalFreq( 3, 24, 6, 1 ); 

selfAddLocalFreO( ePlus, 0, 24, 9, 1 ); 
crossAddLocalFreO( -4, 4, 24, 5, 1 ); 

crossAddLocalFreO( eDeltaPlus, -4, 4, 24, 7, 1 ); 
crossAddLocalFreO( eDeltaPlus, -3, 3, 23, 5, 2 ); 
crossAddLocalFreO( ePlus, 2, 0, 22, 7, 2 ); 
crossAddLocalFreO( ePlus, -2, 2, 24, 5, 3 ); 
crossAddLocalFreO( eMinus, -3, 3, 24, 13,3); 
crossAddLocalFreO( eDeltaPlusP2, 1, 0,23, 8,3); 
crossAddLocalFreO( eMinus, 1, 0, 23, 5,4); 
crossAddLocalFreO( eDeltaPlus, -2, 2, 24, 6,4); 
crossAddLocalFreO( ePlus, -2, 2, 24, 4, 5 ); 
crossAddLocalFreO( eMinus, -3, 3, 24, 9, 5 ); 

} 

void CoincidenceRT::doGA() 

{ 

//doVowels(); 

//doFricatives(); 
// doNonFricatives(); 
} 

void CoincidenceRT::eCrossColumn( int delta, int tstart, int tstop, int fWidth, int 
whichScale=0 ) 

{ 

int scaleBase = whichScale * columnSize; 

// Energy by itself 

double sum = 0.0; 

for ( int t = tstart; t < tstop; t++ ) 

sum += get( t, 0, scaleBase ) * get( t+delta, 0, scaleBase ); 
put( sum ); 

for ( int f = 1; f <= columnSize-fWidth; f += fWidth ) 
{ 

sum = 0.0; 

for ( int t = tstart; t < tstop; t++ ) 
{ 

float* pi = getAddr( t, 0, scaleBase ); 
float* p2 = getAddr( t+delta, f, scaleBase ); 
for ( int i = 0; i < fWidth; i++ ) 
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sum += *pl * *p2++; 
} 

put( sum ); 

> 

> 

// N = 1+ numberOfFreqs/fWidth 

void CoincidenceRT::eCrossColumn( eGateType eGate, int delta, int tstart, int tstop, int 

fWidth, int whichScale=0 ) 

{ 

int scaleBase = whichScale * columnSize; 

int outOffset = whichScale * numberOfTimes; 

char* eGateA = pGate + gateStride * eGate + outOffset; 

// Energy by itself 
double sum = 0.0; 

int stop = min( numberOfTimes- 1 -delta, tstop ); 
int start = max( 0-delta, tstart); 
for ( int t = start; t < stop; t++ ) { 

sum += get( t, 0, scaleBase ) * get( t+delta, 0, scaleBase ); 

put( sum ); 

for ( int f = 1; f <= columnSize-fWidth; f += fWidth ) 
{ 

sum = 0.0; 

for ( int t = start; t < stop; t++ ) 
{ 

if ( eGateA[t] ) { 

float* p2 = getAddr( t+delta, f, scaleBase ); 
for ( int i = 0; i < fWidth; i++ ) { 
sum += *p2++; 

} 

} 

} 

put( sum ); 

void CoincidenceRT::selfAddLocalFreq( int tstart, int tstop, int localN, int whichScale ) 

{ 

int scaleBase = whichScale * columnSize; 

// Do full self product, but amalgamate by localN 
for ( int fl = 1; fl < columnSize-localN; fl += localN ) 
{ 
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for ( int £2 = 1; £2 <= fl ; f2 += localN ) 

{ 

double sum = 0.0; 
for ( int t = tstart; t < tstop; t++ ) 
{ 

float* pi = getAddr( t, fl, scaleBase ); 
float* p2 = getAddr( t, £2, scaleBase ); 
for ( int i = 0; i < localN; i++ ) 
sum += *pl++ * * p 2++; 

} 

put( quo( sum, tstop - tstart ) ); 

} 

} 

> 

// N = ( numberOfFreqs / localN ) * ( numberOfFreqs / localN - 1 ) / 2 
void CoincidenceRT::selfAddLocalFreq( eGateType eGate, int tstart, int tstop, int fWidth, 
int whichScale ) 

5 { 

int scaleBase = whichScale * columnSize; 
int outOffset = whichScale * numberOfTimes; 
char* eGateA = pGate + gateStride * eGate + outOffset; 

// Do full self product, but amalgamate by fWidth 
for ( int fl = 1; fl < columnSize-fWidth; fl += fWidth ) { 
for ( int £2 = 1; £2 <= fl; f2 += fWidth ) { 
double sum = 0.0; 
for ( int t = tstart; t < tstop; t++ ) { 
if(eGateA[t]) { 

float* pi = getAddr( t, fl, scaleBase ); 
float* p2 = getAddr( t, £2, scaleBase ); 
for ( int i = 0; i < fWidth; i++ ) { 



fy 



} 

} 

put( sum ); 



} 



sum += *pl++ * *p2++; 



// N - ( numberOfFreqs / fWidth ) **2 

void CoincidenceRT::crossAddLocalFreq( int delta, int tstart, int tstop, int fWidth, int 
whichScale ) 
{ 

int scaleBase = whichScale * columnSize; 
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// Do full cross product, but amalgamate by 2s 
for ( int fl = 1 ; fl <= columnSize - fWidth; fl += fWidth ) 
{ 

for ( int £2 = 1; £2 <= columnSize - fWidth; £2 += fWidth ) 
{ 



double sum = 0.0; 
for ( int t = tstart; t < tstop; t++ ) 
{ 

float* pi = getAddr( t+delta, fl, scaleBase ); 
float* p2 = getAddr( t, £2, scaleBase ); 
for ( int i = 0; i < fWidth; i++ ) 



void CoincidenceRT::crossAddLocalFreq( eGateType eGate, int delta, int tstart, int tstop, 
int fWidth, int whichScale ) 



int scaleBase = whichScale * columnSize; 

int outOffset = whichScale * numberOfTimes; 

char* eGateA = pGate + gateStride * eGate + outOffset; 

// Do full cross product, but amalgamate by 2s 

for ( int fl = 1 ; fl <= columnSize - fWidth; fl += fWidth ) { 

for ( int £2 = 1; f2 <= columnSize - fWidth; f2 += fWidth ) { 
double sum = 0.0; 
for ( int t = tstart; t < tstop; t++ ) { 
if ( !eGateA[t] ) continue; 



float* pi = getAddr( t+delta, fl, scaleBase ); 
float* p2 = getAddr( t, £2, scaleBase ); 
for ( int i = 0; i < fWidth; i++ ) 
sum +=*pl++* *p2++; 

} 



sum += *pl++ * *p2++; 



} 

put( sum ); 
} 



} 



} 



{ 



put( sum ); 



> 
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